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Abstract — This paper presents an information-theoretic ap- 
proach to address the phasor measurement unit (PMU) place- 
ment problem in electric power systems. Different from the 
conventional 'topological observability' based approaches, this 
paper advocates a much more refined, information-theoretic 
criterion, namely the mutual information (MI) between the PMU 
measurements and the power system states. The proposed MI 
criterion can not only include the full system observability as 
a special case, but also can rigorously model the remaining 
uncertainties in the power system states with PMU measure- 
ments, so as to generate highly informative PMU configurations. 
Further, the MI criterion can facilitate robust PMU placement 
by explicitly modeling probabilistic PMU outages. We propose a 
greedy PMU placement algorithm, and show that it achieves an 
approximation ratio of (1 — 1/e) for any PMU placement budget. 
We further show that the performance is the best that one can 
achieve in practice, in the sense that it is NP-hard to achieve 
any approximation ratio beyond (1 1/e). Such performance 
guarantee makes the greedy algorithm very attractive in the 
practical scenario of multi-stage installations for utilities with 
limited budgets. Finally, simulation results demonstrate near- 
optimal performance of the proposed PMU placement algorithm. 

Index Terms — Phasor measurement unit, electric power sys- 
tems, submodular functions, mutual information, greedy algo- 
rithm. 



I. Introduction 

SYNCHRONIZED measurement technology (SMT) has 
been widely recognized as an enabler of the emerging real- 
time wide area monitoring, protection and control (WAMPAC) 
systems Q), (2|. Phasor measurement unit (PMU), being the 
most advanced and accurate instrument of SMT, plays a 
critical role in achieving key WAMPAC functionalities Q. 
With better than one microsecond global positioning system 
(GPS) synchronization accuracy, the PMUs can provide highly 
synchronized, real-time, and direct measurements of voltage 
phasors at the installed buses, as well as current phasors of 
adjacent power branches. Such measurements are vital for 
the efficient and reliable operations of the power systems by 
both improving the Situational Awareness (SA) of the grid 
operators, and facilitating synchronized and just-in-time (JIT) 
automated control actions J4), J3] . 

Given the critical role of PMUs for the power system, it 
is important that these instruments are installed at carefully 
chosen buses, so as to maximize the 'information gain' on the 
system states, and achieve desired functionalities efficiently. 
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Currently, there is a significant performance gap between the 
existing research and the desired 'informative' PMU configu- 
ration |6), Q. One particular reason is that most researches 
center around the topological observability criterion, which 
only specifies that power system states should be uniquely 
estimated using minimum number of PMU measurements [8]. 
Based on such criterion, many solutions were proposed, such 
as the ones based on mixed integer programming (9), iflOll . 
binary search ifTTI . and metaheuristics 1121 . 1131 . While it 
is true that all PMU configurations can monitor the power 
system states with similar accuracy once the system becomes 
fully observable, these PMU placement approaches can yield 
quite suboptimal results for the important and current sit- 
uation, where the number of installed PMUs is far from 
sufficient to achieve full system observability. The reason is 
as follows. Firstly, the 'observability' criterion is very coarse, 
which specifies the information gained on the system states as 
binary, i.e., either observable or non-observable. Such crude 
approximation essentially assumes that the states at different 
buses are completely independent (with exceptions for buses 
with zero injection), in that the knowledge of the state of a 
bus has zero information gain on the state of any other bus, 
as long as that bus is not 'observable'. This is clearly not 
the case for power systems, where the system states exhibit 
high correlations, due to the fundamental physical laws, such 
as KVL and KCL. Secondly, the observability approaches 
neglect important parameters of the power system, such as 
transmission line admittances, by focusing only on the binary 
connectivity graph. In this sense, if zero injection are not 
considered, the current researches is essentially the classic 
'dominating set' problem fl4l . where a subset of buses in 
the system are selected, so that every bus is either in the 
subset, or a neighbor of the subset. Such over-simplification 
of the power system is very likely to result in suboptimal 
design and significant performance loss. For example, it has 
been shown in 0, Q that PMU configurations can have large 
influence on the accuracy of the state estimation, even though 
the observability result stays the same. 

To overcome the performance limitation of current ap- 
proaches, in this paper, we advocate a much more refined, 
information-theoretic criterion to generate highly informative 
PMU placement configurations. Specifically, we rigorously 
model the 'information gain' achieved by the PMUs states 
as the Shannon mutual information (MI) lfT31l between the 
PMU measurements and the power system states. The MI 
criterion is very popular in the statistics and machine learning 
literature IT6ll . IfTTI . which has found many applications in 
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sensor placement problems. For power systems, we will show 
that it can include the 'topological observability' by current 
researches as a special case. Not only this, the MI criterion can 
also incorporate probabilistic PMU failures, to facilitate robust 
PMU placement configurations. A related work is the entropy 
based approach ifTHl . where the PMU buses were selected, so 
that the 'information content' of the PMU response signals 
from certain transient-stability program can be maximized. 
In fl8l . the 'information' is represented by the norm of 
the entropy matrix of PMU response signals. Compared to 
their method, the MI criterion in this paper directly models 
the uncertainties in the power system states. Further, the MI 
criterion is rigorous, based on the analytical DC model of the 
power system. 

As a second contribution of this paper, we present a greedy 
PMU placement algorithm, and show that it can achieve 
(1 — 1/e) of the optimal information gain for any PMU budget 
K. We further prove that the approximation ratio is the best 
that one can achieve in practice, by showing that it is NP- 
hard to approximate with any factor larger than (1 — 1/e). 
Compared to existing approaches, the greedy algorithm can 
not only achieve the best performance guarantee, but also 
can be easily extended to large-scale power systems. Further, 
the greedy PMU placement is very attractive in the practical 
scenario of multi-stage PMU installation, where utilities prefer 
to install the PMUs over a horizon of multiple periods, due to 
limited budgets [19|. In such cases, utilities can simply adopt 
the greedy placement strategy, as the (1 — 1/e) approximation 
ratio holds for any K. On the other hand, existing multi-stage 
methods |19|, [20 1 may incur significant performance loss if 
the multi-period budget changes unexpectedly. 

The remaining of this paper is organized as follows. Section 
[II] describes the power system and measurement models, and 
Section [III] formulates the optimal PMU placement problem. 
Section [TV] proposes the greedy PMU placement algorithm 
and analyzes its performance, and Section [V] demonstrates the 
numerical results. Finally, Section [V71 concludes this paper. 

II. System Model 

In this section, we formulate a Gaussian Markov random 
field (GMRF) model lED for the system states, and describe 
the measurement models. 

A. GMRF Model for Phasor Angles 

A DC power flow model ll22l is assumed in this paper, 
where the power injection P" 1J at bus i can be expressed as 
follows: 

= I >,,'>, + (!) 

In above, A/i is the set of neighboring buses of i, B. L j is 
imaginary part of the nodal admittance matrix Y, and 9{ is the 
voltage phasor angle at bus i. The uncertainties in the power 
injection vector P lnj can often be approximated as Gaussian by 
existing stochastic power flow methods |23l . In this paper, we 
assume that P lnj is distributed as j\f(n, £). Denote bus as the 
slack bus. We are only interested in the states at non-reference 
buses, as the angle of the slack bus can be uniquely specified 
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Fig. 1. The one line diagram of a power system with 5 buses. The square 
node represents the measurement of active power flow from bus 1 to 2. Two 
PMUs are installed at bus 1 and 4. 



by the non-reference bus angles, due to the law of conservation 
of energy. Write the non-reference bus angles in vector form 
as — (6*i, 02, ■ ■ ■ , 0n) T ■ Note that the system states 6 are 
highly correlated statistically, due to the DC model in (Q~|). 
Formally, the dependency of these variables are described by 
the following theorem: 

Theorem 1: Assume the power system is fully connected. 
Under the DC model, 6 forms a GMRF with mean _B _1 /x and 
covariance matrix B~ 1 'EB~ 1 . 

Proof: Since the power system is fully connected, the 
matrix B is invertible l24l . Thus, the states can be calculated 
as 9 = B~ 1 P lni , from which the theorem follows. ■ 

Fig. HI illustrates a 5-bus power system, with its GRMF 
model shown as the shaded region in Fig. [2] In this case, 
the GRMF is formed by connecting two-hop neighbors of the 
buses in the original power system, as the power injections 
are assumed to be independent. We next describe the PMU 
measurement model. 

B. Measurement Model 

1) Conventional Measurements: As the DC model is as- 
sumed in this paper, the conventional measurements only 
include the real power injection {.z™ nv } and real power flow 
{ z iT v }- Under the DC model, these measurements can be 
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are measurement noises, which are 



distributed as j\f(0, nf m ) and j\f{0, A<° nv ), respectively. 

2) PMU Measurements: A PMU placed at bus i can 
measure both the voltage at bus i and the currents of selected 
incident branches. This implies that the phasor angles of 
corresponding adjacent buses can also be directly calculated. 
Thus, we assume the following equivalent PMU measurement 
model. We associate a PMU placed at bus i with a vector 
z PMU (i), such that 
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: PMU (i) = (^-y + e^Vje?, (5) 
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where e™ u and e™ u are measurement noises with distribu- 
tion jV(0, k™ u ) and jV(0, k™ u ), respectively. P t C A/"* is 
a subset of neighbors of bus i. This is because of the PMU 
channel limits, which implies that only a subset of adjacent 
branches can be monitored. The variances k™ u and 
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Fig. 2. The probabilistic graphical model for the non-reference bus angles 
in the power system in Fig. [T] The shaded region illustrates the GMRF for 
system states. The power injections are assumed to be independent. 

depend on various sources of uncertainties, such as the GPS 
synchronization, instrument transformers, A/D converters and 
cable parameters, which can be estimated appropriately |25ll . 
Further, PMU failures can be modeled by assuming that each 
current measurement z PMU (i) outputs a failure message with 
probability 1 — a™ u , and similarly, each voltage measurement 
fails with probability 1 — a PMU , where a PMU and a PMU are 
the availability of the current and voltage measurements, 
respectively. 

As an illustration, Fig. [2] represents the probabilistic graph 
model for the measurement configuration in Fig. [T] where 
the gray nodes represents the measurement variables. From 
the figure, it is clear that the information gain of PMU 
measurements depends heavily on the placement buses. This 
will be formalized in the next section by the optimal PMU 
placement problem. 

III. Optimal PMU Placement 

The placement configuration of PMUs should be highly 
'informative' to effectively monitor power system states. In 
this paper, we advocate an information-theoretic criterion 
to quantitatively assess the 'information gain' that can be 
obtained from the PMU measurements. Specifically, we model 
the uncertainties in the system states as the Shannon entropy 
OH: 

ff(0)=£-p(0)logp(0) (6) 
e 

where p(9) is the probability mass function of 9. In this paper, 
we assume that the entropies of all variables are calculated 
after quantization with a sufficiently small step size A. This is 
motivated by the fact that the phasor angles in power systems 
are observed by meters with finite accuracy. Denote S as the 
set of PMU configurations, where each element s — {i,Vi} 
in the set S corresponds to a candidate PMU configuration as 
in (O and (0. Note that our model is very general, which can 
be used to model PMU channel limits. The information gain 
of the PMU configuration S can be assessed by the entropy 
reduction due to PMU measurements z PMV (S): 

1(9; z PMU (S)) = H(9) - H(9\z PMU (S)) (7) 

where 1(9; z PMl] (S)) is the Shannon mutual information (MI) 
between the PMU measurements and the power system states, 
and H (9\z PMV (<S)) is the conditional entropy. Finally, when 
conventional measurements are considered, the uncertainty 



reduction corresponds to the conditional MI: 

/(0;^ PMU (5)|^ conv ) = H(d\z com ) - H(9\z PMU (S),z com ) 

The MI criterion is widely adopted in the machine learning 
literature to generate highly informative sensor placement 
configurations 1 16 1. For the PMU placement problem in power 
systems, we claim that the MI criterion is also intimately 
related to the power system observability and state estimation 
accuracy, which we elaborate as follows: 

1) {Observability): The proposed MI criterion can include 
the observability criterion as a special case. To see this, assume 
no PMU failure and PMU measurement noise. We claim that 
the maximum information gain is achieved if and only if the 
power system is completely observable from PMU measure- 
ments. This can be clearly observed from (0, where the MI 
function is maximized if and only if H(9\z pmj (S)) — 0, in 
which case the system states are deterministic given the PMU 
measurements z pmj (S). 

2) (State Estimation Error): The proposed MI function 
is also intimately related to the minimization of the state 
estimation error. In fact, the conditional entropy H(9\z PMl] ) 
can then be expressed as follows: 

H(9\z PMV ) « logdetCov(e) + C - N\og A (8) 

where C is a constant, and e = 9 — 0mmse(-z pmu ) is the 
estimation error of the Minimum Mean Square Error (MMSE) 
estimation of 9 given z PMV , and Cov(-) is the covariance 
matrix. The error in the above approximation is due to the 
quantization, and goes to zero as the quantization step size 
A —> 0. Thus, it is clear that the maximization of MI can also 
lead to minimizing the MMSE error e of the power system 
states. Intuitively, H(9\z PMV ) specifies how 'peaked' the 
distribution of estimated power system states behaves around 
the mean value. In the statistics literature, such criterion is 
referred to as the 'D-optimality' fl6l . 

We are now ready to formulate the optimal PMU placement 
problem. Assume that there are a total of K PMUs to be 
installed in the power system. The goal is to choose a subset 
of PMU configurations S* from a set of candidate PMU 
configurations, such that 

S* £ arg max FAS), i = 1, 2. (9) 
\S\<K 

The objective functions are illustrated as follows: 

1) (PMU Measurements Only) In this case, the objective 
function associated with a PMU placement set S is 

Fx(S) = if>(0;z PM V)) (10) 

t=i 

where the dependence on time index t is because the 
power system states 9 have time-dependent distribution 
J\f(B~ 1 fj, t , B~ 1 Y, t B~ 1 ), due to the changes in real power 
injections over time. Thus, the objective function in ( fTOl ) 
describes the 'time averaged information gain' about the power 
system state over a time period of interest (such as one day). 

2) (With Conventional Measurements) When conventional 
measurements are considered, the objective function should 
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be replaced with the conditional MI function, as follows: 
1 T 

W) = y£/t(fl;« FMD (5)l« aro ) (ID 

{=1 

Note that it is possible that the time scales can be different 
in both cases, as the conventional measurements can have 
much slower sampling rate (on the order of minutes) than 
PMU measurements. Having formulated the optimal PMU 
placement problem, we will discuss the solutions in the next 
section. 

IV. Greedy PMU Placement 

It is highly desired that the PMUs are optimally placed 
in the power system. However, the optimal solution is very 
hard to obtain, as the optimal PMU placement problem is 
NP-complete [26|. In this section, we propose a greedy PMU 
placement algorithm, and show that it can achieve the optimal 
performance guarantee among the class of polynomial time 
algorithms. 

A. Hardness Result 

Before presenting the greedy algorithm, we first demonstrate 
the hardness result. We extend the hardness result in [26|, by 
showing that the optimal PMU placement problem is not only 
NP-hard to solve, but also NP-hard to approximate beyond the 
approximation ratio of (1 — 1/e): 

Theorem 2: Unless P = NP, there is no polynomial time 
algorithm for the optimal PMU placement problem in © with 
better approximation ratio than (1 — 1/e). 

Proof: See in Appendix lAl ■ 
We next propose a greedy PMU placement algorithm, which 
can achieve the (1 — 1/e) approximation ratio. 

B. Greedy PMU Placement 

The greedy PMU placement algorithm is shown in Al- 
gorithm Q] Compared to the optimal placement, the greedy 
algorithm has low complexity, and is easy to implement in 
large-scale systems. In each step, the algorithm chooses the 
next candidate PMU configuration that can achieve the largest 
'marginal information gain', where the objective function F(-) 
can be chosen as either Fx or F 2 , depending on whether 
conventional measurements are included. 



Algorithm 1 Greedy PMU Placement 
l: Initialize: S <- 0; 

2: for k = 1 to K do 

3: iS-(-(SU {s*}, where s* solves the following: 

s* = argmaxF(5U {s}); (12) 

4: end for 
5: return S 



The next theorem shows that the greedy algorithm can 
achieve the largest approximation ratio of (1 — 1/e). 



TABLE I 
Computation Time 



Test Systems 


Time (Seconds) 


IEEE 14-bus (PMU Only) 


0.7093 


IEEE 14-bus (Conventional) 


2.5543 


IEEE 57-bus (PMU Only) 


2.9141 x 10 3 


IEEE 57-bus (Conventional) 


3.4556 x 10 4 



Theorem 3: The greedy PMU placement in (fl~|i can achieve 
an approximation ratio of (1 — 1/e) for both objective functions 
Fi(-) and F 2 (-). 

Proof: The proof is obtained by identifying a key prop- 
erty, submodularity, of the PMU placement problem. Detailed 
proof is in Appendix IB"1 ■ 

We have the following remarks: 

1) Optimality: Based on Theorem [2] and [3] we claim 
that the greedy algorithm can achieve the best performance 
guarantee that is possible. Further, compared to methods 
such as mixed integer programming |9], |10|, binary search 
IfTTI . or metaheuristics JT2), fOl , the greedy algorithm is 
not only the best in performance guarantees, but also can 
be easily implemented in large-scale systems, due to the low 
computation complexity. 

2) Multi-stage Installation: The greedy algorithm is very 
attractive in the case of multi-stage installations, where the 
utilities plan to install the PMUs over a horizon of multiple 
years, due to the limited (and possibly uncertain) budgets. In 
such scenarios, the greedy algorithm can always achieve an ap- 
proximation ratio of (1 — 1/e) for any given K, whereas fixed 
multi-stage planning algorithms may suffer from substantial 
performance loss when the budget K changes unexpectedly. 

Having formulated the greedy PMU placement algorithm 
and proved its optimality results, we will test it against other 
methods in standard IEEE test systems in the next section. 

V. Numerical Results 

This section demonstrates the performance of the proposed 
greedy PMU placement algorithm, and compare it with the 
PMU placement results in the literature. 

A. System Description 

In the simulation, real power injections are assumed to be 
normally distributed, and independent across different buses 
11231 . For each bus, the standard deviation of the real power 
injection is assumed to be 10% of the mean value. For 
each time slot, the mean real power injections at all buses 
are obtained by properly scaling the case profile description 
of the standard test system [27 1 . Thus, the MI function at 
different time slots are only different by a multiplicative factor. 
Each PMU measurement is assumed to fail independently 
with probability 0.03 EO). The standard error of all PMU 
measurements are assumed to be 0.02°, whereas the standard 
error of conventional measurements are assumed to be 0.57°. 
Finally, for comparison purposes, we consider the 'topological 
observability' based PMU placement configurations in [28 1, 
which are obtained based on mixed integer programming. All 
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IEEE 14-Bus System, PMU Only 




Number ol PMU 

(a) 

Fig. 3. Normalized information gain of different PMU placement schemes 
conventional measurements. 



TABLE II 

PMU Locations for IEEE 14-Bus System 



K 


Optimal 
(PMU Only) 


Greedy 
(PMU Only) 


Optimal 
(Conventional) 


Greedy 
(Conventional) 


1 


4 


4 


6 


6 


2 


4, 13 


4, 13 


4, 13 


6, 9 


3 


4, 6, 9 


4, 9, 13 


4, 6, 14 


4, 6, 9 


4 


4, 6, 9, 13 


4. 6, 9, 13 


4, 6, 9 ,13 


4, 6, 9, 13 



simulation results are obtained with MATLAB on an Intel 
Xeon E2540 CPU with 8GB RAM. The computation time 
is shown in Table |T] 

B. IEEE 14-Bus System 

1) PMU Measurements Only: For this case, the optimal 
PMU locations are calculated by an exhaustive search among 
all possible configurations. The PMU locations for both opti- 
mal placement and greedy placement for K < 4 are shown in 
Table HH From the table, one can observe that the optimal PMU 
configuration can change significantly over different placement 
budget K. For example, when K = 2, the optimal placement 
is {4, 13}, whereas for K = 3, the optimal placement is 
{4,6,9}. On the other hand, the greedy placement configu- 
ration S g {K) always satisfy S g (K — 1) C S g (K). Thus, the 
greedy placement strategy is robust against the uncertainties 
in the placement budget K. To verify the placement results, 
we plot the standard deviations of the phasor angles at all non- 
reference buses in Fig. [4] From the figure, one can observe that 
the state at bus 3 has the largest variance. However, bus 3 is not 
chosen as the first PMU bus, since, intuitively, it is connected 
to only two neighbors in the system (see the topology in [27 1). 
Instead, bus 4 is chosen, since it has five neighbors. 

Fig. [3] (a) shows the normalized information gain for the 
IEEE 14-bus system with only PMU measurements. In the 
figure, the 'Upper Bound' curve is computed by the op- 
timal PMU configuration assuming no PMU failure. Thus, 
it overestimates the information gain on the system states. 
One can easily observe the near optimal performance of the 



IEEE 14-Bus System, With Conventional Measurements 
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in the IEEE 14-bus system, (a) with PMU measurements only and (b) with 



Standard Deviation in IEEE 14-Bus System 




Bus Index 

Fig. 4. Standard deviation of voltage angles in the IEEE 14-bus system. 



greedy PMU placement strategy, in that the 'Greedy' curve 
is very close to the 'Upper Bound'. Further, the greedy 
algorithm has a significant improvement on information gain 
compared to the conventional 'observability' based approach. 
For example, for K — 3, the improvement is around 20% 
as compared to the observability based placement |28l . This 
clearly demonstrates the performance loss associated with the 
coarse observability based criterion. Finally, one can observe 
from the 'Upper Bound' curve that the maximum information 
gain has a 'diminishing marginal return' property, in that the 
marginal information gain tends to decrease as the number of 
installed PMUs in the power system grows. This also confirms 
the submodularity of the MI objective function. 

2) With Conventional Measurements: In this case, real 
power flow measurements are assumed to be configured at 
all branches and buses. The resulting PMU configurations are 
shown in Table [HI From the table, one can conclude that 
the optimal PMU placement is even more vulnerable to the 
changes in the PMU placement budget K than the PMU 
only case, as the configurations changes significantly as K 
increases. On the other hand, the greedy algorithm is robust, 
as S g (K — 1) C S g (K) for any K > 1. The normalized 
information gain is shown in Fig. [3] (b). As the power system 
is already observable with conventional measurements, we 
use the same configuration for the 'Observable' curve as the 
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IEEE 57-Bus System, PMU Only 
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Fig. 5. Normalized information gain of different PMU placement schemes in 
conventional measurements. 



TABLE III 

PMU Locations for 57-Bus System by Greedy Algorithm 



Test Scenarios 


PMU Locations 


IEEE 57-Bus (PMU Only) 


9, 56, 18, 31, 12, 49, 29, 6, 
25, 54, 20, 41, 38, 51, 32, 
13, 27, 53, 57, 15, 19, 8, 30, 
50, 17, 5, 16, 42, 52, 48, 55, 
44, 24, 34 


IEEE 57-Bus (Conventional) 


56, 31, 19, 12, 54, 49, 25, 
41, 32, 9, 29, 18, 6, 50, 20, 

57, 27, 53, 38, 30, 13, 42, 
51, 17, 55, 52, 5, 24, 34, 43, 
16, 44, 8, 10 



previous case. One can observe that the performance gain is 
larger compared to the case with only PMU measurements. 
This, again, confirms the conclusion that the pure topology 
based observability criterion can not efficiently model the 
uncertainties in the power system states. 

C. IEEE 57-Bus System 

1 ) PMU Measurements Only: For the IEEE 57-bus system, 
it is computationally infeasible to obtain the optimal PMU 
configuration for large K. In such case, we only demonstrate 
the performance of the greedy PMU placement, and compare 
it against the observability based results in [28 1. For the case 
with only PMU measurements, the resulting PMU configura- 
tions are shown in Table Hill and the normalized information 
gain is shown in Fig.|5](a). Similar to the IEEE 14-bus system, 
one can conclude that the greedy algorithm can achieve a 
significant information gain compared to the observability 
based criteria. This is because of the much more refined 
modeling of the MI function, which can effectively capture 
the remaining uncertainties in the states of the power system. 
Further, the information gain of the greedy placement curve 
also demonstrates the 'diminishing marginal return' property. 

2) With Conventional Measurements: In this case, real 
power flow measurements are assumed to be configured at all 
branches and buses. The resulting greedy PMU configurations 



IEEE 57-Bus System, With Conventional Measurements 




Number ol PMU 

(b) 

the IEEE 57-bus system, (a) without conventional measurements and (b) with 



are shown in Table [TTT] The normalized information gain is 
shown in Fig. [5] (b), where the greedy algorithm is compared 
against the same configuration in the previous case, Similar to 
the case without conventional measurements, one can observe 
the significant performance gain of the greedy algorithm. 
Note that, in this case, the power system is observable with 
conventional measurements. Therefore, the observability based 
methods fail to compute effective PMU configurations, due to 
the coarse modeling of the uncertainties in the power system 
states. 

VI. Conclusion 

This paper proposed an information-theoretic approach to 
address the phasor measurement units (PMUs) placement 
for power system. Different from the topological observabil- 
ity based criterion in the literature, this paper proposed a 
much more refined, information-theoretic criterion, namely the 
mutual information (MI), as the PMU placement objective 
function. The proposed MI criterion can not only include 
the complete observability criterion as a special case, but 
also can accurately model the uncertainties in the system 
states. We further proposed a greedy PMU placement algo- 
rithm, and showed that it achieves an approximation ratio of 
(1 — 1/e) for any PMU budget K, which is the best guar- 
antee among polynomial-time algorithms. Such performance 
guarantee makes the greedy algorithm attractive in the typical 
scenario of phased installations, as the performance is robust 
to the changes in the PMU budget. Finally, the performance 
of the proposed PMU placement algorithm was demonstrated 
by simulation results. 

Appendix A 
Proof of Theorem[2] 

Proof: We prove the hardness result by constructing 
polynomial-time reduction of an arbitrary instance of the 
max fc-cover problem [29 1 to a PMU placement problem. 
Thus, the hardness result easily follows from the (1 — 1/e) 
inapproximability of the max fc-cover problem (29). The 
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max fc-cover problem is as follows. We are given a set 
of elements U = {1,2, ... ,N}, and a collection of sets 
P = {Pi, V%, ■ . ■ ,Vm}, where each set V% is a subset of 
U. The task is to compute a subcollection of K subsets 
Vli , Vi 2 , ■ . ■ , Vi K , such that the cardinality | U^ =1 Vi k \ is 
maximized. Now, the reduction is as follows. Given a max 
fc-cover problem instance, we construct a power system with 
N + 1 buses, so that two buses (i,j) are connected by 
a transmission line if and only if they both appear in a 
certain subset in P. Further, we associate each subset Pi 
in P with a PMU, which is installed at a fixed (but can 
be arbitrarily chosen) bus in Pi. Assume that the co variance 
matrix of the power injections P m> is £ = jB 2 , where 7 is a 
proper scalar that will be discussed later. Thus, according to 
Theorem [T] the resulting GMRF of 9 has covariance matrix 
7/. Finally, choose 7 so that each discrete random variable (?, 
has entropy 1 . Assume there is no PMU failure, and zero PMU 
measurement noise, we can write the MI objective function as 
follows: 



I(9;z PMV (S)) = H(9)~H(9\z PMV (S)) 
( = } N-H(9\z PMV (S)) 



^ N-\U keS Pk\ 
= \^kesV k \ 



(13) 
(14) 

(15) 
(16) 



where (a) is because the phasor angles are independent, and 
each has entropy 1, by construction, (b) is because given 
the PMU measurements, the uncertainties only remain at the 
phasor angles of the 'unobservable buses' UkesPk- Denote 
P as the set of all possible PMU placement configurations. 
Thus, if we can solve the optimal PMU placement problem 
by maximizing 1(9; z PMV (S)) subject to |<S| < fc beyond 
(1 — 1/e) in polynomial time, we can also achieve the 
same performance guarantee for the max fc-cover problem in 
polynomial time, from which the theorem follows. ■ 

Appendix B 
Proof of Theorem[3] 

We now prove the (1 — 1/e) performance guarantee of 
Algorithm [T] The key lies in identifying the submodular 
property of the PMU placement problem, which is a widely 
used concept in combinatorial optimizations. 

A. Introduction to Submodular Functions 

A set function F is called submodular [ 30 1 if 

F(AU {k}) - F(A) >F(BU{k})-F(B) (17) 

for any sets A and B such that A C B. Essentially, this is the 
'diminishing marginal return' property, which, in the context 
of PMU placement, specifies that the marginal 'information 
gain' is decreasing as the number of installed PMU increases. 
A set function F is nondecreasing if S C T implies that 
F(S) < F(T), for all sets S and T. The importance 
of submodularity can be seen by considering the following 
combinatorial optimization problem: 



For nondecreasing submodular functions, the following guar- 
antee always holds for the greedy algorithm [ 30 1 : 

Lemma 1: Let a set function F(-) be submodular, nonde- 
creasing and F(0) = 0. For any K > 1, denote S* (K) and 
S g (K) as the optimal solution to the problem (TT~8T > and the 
solution obtained by Algorithm [T] respectively. Then, 



F(S g (K))>(l-l/e)F(S*(K)) 



(19) 



always holds. Thus, Algorithm Q] can achieve at least an 
approximation ratio of (1 — 1/e). 

B. Proof of Theorem \3\ 

Proof: We now prove the theorem by showing that the 
objective functions F\(-) and -F2O) for the optimal PMU 
placement problem satisfy all assumptions in Lemma Q] We 
first fix time index t, and consider the case without conven- 
tional measurements. It is easy to see that h(9; z PMU (0)) = 0. 
We next verify (T% as follows: 

1(9; z PMU (A U a)) - 1(6; z PMU (^)) (20) 

( = ] I(8;z PMl] ( S )\z PMl] (A)) (21) 

^ H(z PMV ( s )\z PMl] (A)) 

-H{z PMXJ {s)\e,z PMX] (A)) (22) 



H(z PMU (s)\z PMU (A)) - H(z PMU (s)\8) (23) 



S* = arg max F(S) 

\S\<K 



(18) 



In above, time index is omitted for notation simplicity, (a) 
follows from the chain rule of MI [15|. (b) follows from 
the definition of conditional MI. (c) is because z PMV (s) is 
conditionally independent of z PMV (A) given 6, due to the 
measurement model in and (|5j. This can also be clearly 
observed from the probabilistic graphical model in Fig. \V[b), 
where state variables 9 serve as the parent nodes of the 
PMU measurements in the 'Bayesian part' of the graph. Note 
that H(z PMU (s)\z PMV {A)) in ([23} is decreasing in A, as 
conditioning always reduces entropy [15|. Since the second 
term in ( 1231 is independent of A, ( TFTT i follows easily. Finally, 
as conditional MI is always nonnegative, one can deduce from 
(Bil l that the MI function 1(9; z PMU („4)) is also nondecreasing. 

Now, the above analysis can be immediately extended to 
a time period of length T, where ( TP7T i holds for F\(-) by 
summing up the inequalities corresponding to each time slot 
t, and then dividing both sides by T. Thus, we conclude that 
the claim holds for Fi(-). Similarly, an identical analysis can 
be carried out in the case with conventional measurements, 
where all functions in (t2TT>-([23T> hold when conditioned on 
conventional measurements. ■ 
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